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[57] ABSTRACT 

A method and system for displaying a series of images 
captured by a digital camera, which includes a user interface 
that includes a view finder. The method and system first 
stores each of the captured images in memory, and then 
displays a plurality of image cells in the view finder, wherein 
each of the image cells corresponds to one of the captured 
images. The method and system further provides at least one 
of the image cells with an image area for displaying the 
corresponding captured image, and further provides the at 
least one image cell with an icon area for displaying addi- 
tional information regarding the corresponding captured 
image. 

13 Claims, 8 Drawing Sheets 
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METHOD AND SYSTEM FOR DISPLAYING 
IMAGES AND ASSOCIATED MULTIMEDIA 
TYPES IN THE INTERFACE OF A DIGITAL 
CAMERA 

FIELD OF THE INVENTION 

The present invention relates generally to digital cameras, 
and more particularly to a method and system for displaying 
images in the interface of a digital camera. 

BACKGROUND OF THE INVENTION 

Modern digital cameras typically include an imaging 
device which is controlled by a computer system. The 
computer system accesses raw image data captured by the 
imaging device and then processes and compresses the data 
before storing the compressed data into an internal memory. 
Efficient operation of the computer is therefore an important 
consideration for camera designers and manufacturers. The 
memory architecture of a particular computer system deter- 
mines data storage techniques and can thus significantly 
effect the operational efficiency of the entire digital camera 
system. 

Due to architectural limitations of conventional digital 
cameras, there are several drawbacks in the user interface 
that restrict how captured images are displayed and manipu- 
lated by a user. The user interface in conventional digital 
cameras typically includes a view finder for displaying a 
series of image cells. Each image cell, in turn, displays a 
small version of a corresponding captured image. Display- 
ing several cells in this manner allows a user to review 
several images at once. When the user selects one of the cells 
in the view finder, the full-sized version of the image is then 
displayed in the view finder. 

One problem with conventional digital cameras is that the 
file format for storing captured images does not directly 
support the display of image cells. For example, most 
traditional digital cameras store compressed images in a 
particular file format in memory. The file typically includes 
both a header that optionally stores the date and time that the 
image was taken, and the captured image data itself. The 
captured image is usually stored in the file as a Joint 
Photographic Expert Group (JPEG) data. 

When a conventional digital camera is to display a series 
of image cells in the view finder, the digital camera must first 
retrieve the JPEG data from the appropriate files, decom- 
press the data, and then process the uncompressed images by 
resizing the images to the size of the image cells. One 
drawback to this approach is that the decompressing and 
resizing operations reduce the speed at which the camera can 
display the full -sized images in the view finder 

Another drawback is that the file format for storing 
captured images does not support the storage of additional 
information regarding each image that may be of use to the 
user. Thus, a conventional digital camera that has stored 
many pictures can only offer the date and time that each 
image was captured to distinguish the images for the user. 

Accordingly, what is needed is an improved system and 
method for displaying captured images in a digital camera. 
The present invention addresses such a need. 

SUMMARY OF THE INVENTION 

The present invention provides method and system for 
displaying a series of images captured by a digital camera 
that includes a user interface which includes a view finder. 
The method and system first store each of the captured 
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images in memory, and then displays a plurality of image 
cells in the view finder, wherein each of the image cells 
corresponds to one of the captured images. The method and 
system further provide at least one of the image cells with an 

5 image area for displaying the corresponding captured image, 
and further provide the at least one image cell with an icon 
area for displaying additional information regarding the 
corresponding captured image. 
According to the system and method disclosed herein, a 

10 file format is provided that supports the direct display of 
image cells in the view finder. In addition, graphical icons 
are displayed in the image cell regarding the media types 
associated with the image, thereby increasing the ease of use 
and operation of the digital camera. 

15 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a digital camera that operates 
in accordance with the present invention. 
20 FIG, 2 is a block diagram of the preferred embodiment for 
the imaging device of FIG. 1. 

FIG. 3 is a block diagram of the preferred embodiment for 
the computer of FIG. 1. 

FIG. 4 is a block diagram depicting a user interface for the 
25 digital camera. 

FIG. 5 is a block diagram showing a digital camera user 
interface having expanded cells in accordance with the 
present invention. 
3Q FIG. 6 is a block diagram illustrating the format of an 
expanded cell. 

FIG. 7 is a table listing example media types and corre- 
sponding icons that may be associated with a captured 
image. 

35 FIG. 8 is a block diagram of one preferred embodiment 
for a extended file format for storing a captured image that 
supports the display of thumb nail images in accordance 
with the present invention. 
FIG. 9 is a block diagram of a second preferred embodi- 

40 ment for the extended file format that supports multiple 
media types. 

FIG. 10 is a block diagram illustrating a multiple image 
file format that supports multiple image media types. 

45 DESCRIPTION OF THE INVENTION 

The present invention relates to an improvement in dis- 
playing images in a digital camera. The following descrip- 
tion is presented to enable one of ordinary skill in the art to 

50 make and use the invention and is provided in the context of 
a patent application and its requirements. Various modifica- 
tions to the preferred embodiment will be readily apparent to 
those skilled in the art and the generic principles herein may 
be applied to other embodiments. Thus, the present inven- 

55 tion is not intended to be limited to the embodiment shown 
but is to be accorded the widest scope consistent with the 
principles and features described herein. 

The present invention is a digital camera that includes a 
method and system for displaying captured images in a 

60 digital camera. According to the present invention, a method 
and system is provided for supporting the direct display of 
image cells in the view finder, and for extending the image 
cell of each image in order to provide additional information 
regarding the image. 

65 Referring now to FIG. 1, a block diagram of a camera 110 
is shown according to the present invention. Camera 110 
preferably comprises an imaging device 114, a system bus 
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116 and a computer 118. Imaging device 114 is optically preferred embodiment of the present invention, removable 

coupled to an object 112 and electrically coupled via system memory 354 is typically implemented using a flash disk, 

bus 116 to computer 118. Once a photographer has focused Power supply 356 supplies operating power to the various 

imaging device 114 on object 112 and, using a capture components of camera 110. In the preferred embodiment, 

button or some other means, instructed camera U0 to 5 power supply 356 provides operating power to a main power 

capture an image of object 112, computer 118 commands bus 362 and also to a secondary power bus 364. The main 

imaging device 114 via system bus 116 to capture raw image power bus 362 provides power to imaging device 114, I/O 

data representing object 112. The captured raw image data is 348 > ROM 350 ™ 6 removable memory 354. The secondary 

transferred over system bus 116 to computer 118 which V™ eT ^l^^t* P ° WCr l ° P ° WCr mana & er M2 > CPU 

performs various image processing functions on the image 10 DRAM 34o. 

data before storing it in its internal memory. System bus 116 , Powe < supply 356 is connected to mam batteries 358 and 

also passes various status and control signals between imag- also t0 b **JP baltenes J 360 In the P referred embcrfuncatt, 

ing device 114 and computer 118. a ™ m ™ 110 ^ m ^ ^ connect P°, wer SUP ? ly 3 f 6 l ° " 

to r external power source. During normal operation of power 

Referring now to FIG. 2, a block diagram of the preferred supply 356> the main batteries 358 provide operating power 

embodiment of imaging device 114 is shown. Imaging « tQ powef 356 which then provides me operating 

device 114 preferably comprises a lens 220 having an iris, a power to camera 110 via both main power bus 362 and 

filter 222, an image sensor 224, a timing generator 226, an secondary power bus 364. 

analog signal processor (ASP) 228, an analog-to-digital During a power failure mode in which the main batteries 

(A/D) converter 230, an interface 232, and one or more 358 have failed (when their output voltage has fallen below 

motor 234. 20 a minimum operational voltage level) the backup batteries 

In operation, imaging device 114 captures an image of 360 provide operating power to power supply 356 which 

object 112 via reflected light impacting image sensor 224 provides the operating power only to the secondary 

along optical path 236. Image sensor 224 responsively P ower bus 364 of camera 110. Selected components of 

generates a set of raw image data representing the captured camera 110 (including . DRAM 346) are thus protected 

image 112. Hie raw image data is then routed through ASP 25 a S amst a P ower faUure * main battenes 358 - 

228, A/D converter 230 and interface 232. Interface 232 has Power *Wly 356 preferably also includes a flywheel 

outputs for controlling ASP 228, motors 234 and timing capacitor connected to the power lme coming from the mam 

generator 226. From interface 232, the raw image data b n mt ™ 358 " * th f main baltenes ? 58 su K dden * fail l the 

passes over system bus 116 to computer 118. ^ capacUor temporarily mam ains the voltage from 

r J r 30 the mam battenes 358 at a sufficient level, so that computer 

Referring now to FIG. 3, a block diagram of the preferred 118 ^ prolect data currerjt i y being processed by 

embodiment for computer 118 is shown. System bus 116 camera 110 before shutdown occurs, 

provides connection paths between imaging device 114, According to the present invention, the flexible architec- 

power manager 342, central processing unit (CPU) 344, mrc Q f me digital camera provides an improved method for 

dynamic random-access memory (DRAM) 346, input/ 35 displaying captured images in a digital camera. More 

output interface (I/O) 348, read-only memory (ROM) 350, specifically, the present invention provides a method and 

and buffers/connector 352. Removable memory 354 con- system for directly displaying image cells and for extending 

nects to system bus 116 via buffers/connector 352. the cells of each image, such that the ceUs contain additional 

Alternately, camera 110 may be implemented without information regarding the image. In a preferred 

removable memory 354 or buffers/connector 352. ^ embodiment, image cells are extended through the use of an 

Power manager 342 communicates via line 366 with extended file format, and the additional information con- 
power supply 356 and coordinates power management tained in the extended image cells takes the form of graphi- 
operations for camera 110. CPU 344 typically includes a cal icons, as explained further below, 
conventional processor device for controlling the operation /\ EI GK4-is^bl ock;oMagrajn^ 

of camera 110. In the preferred embodiment, CPU 344 is 45 & T the digital camera as described in co-pending U.S. patent 

capable of concurrently running multiple software routines application Ser. No. 08/702,286, filed on Aug. 23, 1996,1 

to control the various processes of camera 110 within a eniitled "A Method and System For Grouping Images In !a! 

multi-threading environment. DRAM 346 is a contiguous Digital Camera," and assigned to the Assignee of the present! 

block of dynamic memory which may be selectively alio- application. In one preferred embodiment, the user interface! 

cated to various storage functions. 50 includes a view finder 402, an image capture button called 

I/O 348 is an interface device allowing communications a| photo button 404, a four-way navigation control button 

to and from computer 118. For example, I/O 348 permits an 406, a menu button 408, a menu area 410 within the view 

external host computer (not shown) to connect to and finder 402, and function keys 412. The user interface may 

commnunicate with computer 118. I/O 348 also permits a als6 include an optional sound button 414 and a mode button! 

camera 110 user to communicate with camera U0 via an 55 416. 1 

external user interface and via an external display panel, [ Referring again to FIGS. 1 and 4, the user interface 400 ' 

referred to as a view finder. operates in two modes: view finder mode and review mode. 

ROM 350 typically comprises a conventional nonvolatile In a preferred embodiment, the photo button 404 is a two 

read-only memory which stores a set of computer-readable position button. The view finder mode begins when a user 

program instructions to control the operation of camera 110. 60 aims the camera at an object 112 and presses the photo 

Removable memory 354 serves as an additional image data button 404 into the first position. Once this occurs, the view 



storage area and is preferably a non-volatile device, readily finder 402 displays the image of the object 112 as shown 



removable and replaceable by a camera 110 user via buffers/ through the camera's imaging device 114. The user may then 
connector 352. Thus, a user who possesses several remov- press the photo button 404 into the second position to 
able memories 354 may replace a full removable memory 65 capture the image shown in the view finder 402. Review 
354 with an empty removable memory 354 to effectively modeJfegiiis_by ,pr^ 

expand the picture-taking capacity of camera 110. In the -c^Opffte*^^ * 1 ~~P 
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Referring again to FIG. 4, once in the review mode, the provides the user with an automatic method for categorizing 
view finder 402 displays a series of cells 418 that represent and identifying common groups of captured images, 
the digital images that have been captured in the digital Th e present invention also eliminates the need for pro- 
camera. The view finder 402 is shown here as displaying cessing captured images when displaying the image cells 
nine image cells 418. Each cell 418 displays a small-sized 5 420 ^ accomplished by extending the file format used 
image corresponding to one of the captured images. The user tQ stQre me captured images 
may navigate through the series of displayed cells 418 in the c r j i_ 
view finder 402 using the four-way navigation control , FIG. 8 is a Mock diagram of one preferred embodiment 
button 406 in order to select which image is displayed for a extended ^format 460 for storing aj captured I image 
full-sized in the view finder 402. The cell 418 currently in m accordance with the present invention. The extended file 
selected by the four-way navigation control 406 is encircled 10 format 460 includes a standard header 462 for storing the 
with a highlighted area 419, which is shown as a selection date and time the image was captured, and JPEG data 464 
rectangle. Other shapes for the highlighted area are also representing the captured image in compressed form. And in 
suitable. contrast to prior file formats, the extended file format 460 

Although the user interface 400 provides many also includes a small version of the captured image, referred 

advantages, the cells 418 for displaying captured images 15 to here as a thumb nail image 466. 

suffer the same drawbacks as the cells used in conventional Including the thumb nail image 466 in the extended file 

digital cameras. The principal drawbacks being a general format 460 enables the digital camera to directly display an 

failure in aiding the user in distinguishing among the cap- image in the image area 422 without processing the JPEG 

lured images, and the requirement of processing each cap- data 464. When the digital camera 118 is to display a series 

tured image in order to display its corresponding image cell 20 0 f image cells 420 in the view finder 402, the corresponding 

418. file formats 460 are first retrieved from memory. The digital 

According to the present invention, the failure of aiding camera 118 then displays the thumb nail image 466 directly 

the user in distinguishing among captured images is from the file 460 in the image area 422 of the cell 420, rather 

addressed by expanding the image cells 418, and by includ- than first decompressing and resizing the JPEG data 464. 

ing additional information in the expanded image cells 418, 25 Avoiding the processing the actual JPEG data 464 in this 

besides a small graphic of the captured image. manner improves the speed at which the camera 118 may 

FIG. 5 is a block diagram showing a digital camera user display the series of image cells 420 in the view finder 402. 

interface 430 displaying a series of expanded cells 420 in FIG. 9 is a block diagram of a second preferred embodi- 

accordance with the present invention. The user interface 3Q ment for the extended file format 470 that supports multiple 

430 is also shown with another preferred embodiment for media types. As in the previous embodiment, the extended 

the layout of the interface buttons, where like components in file format 470 includes a standard header 462', JPEG data 

FIGS. 4 and 5 have like reference numerals. 464', and a thumb nail image 466*. To enable different media 

FIG. 6 is a block diagram illustrating the format of an types to be associated with a captured image, the extended 

expanded cell 420. According to the present invention, each 35 header 470 also includes an information field 472 and a 

cell 420 includes an image area 422 and an icon/information sound field 474. 

area 424. The icon/information area 424 may be placed in The information field 472 comprises a series of tags for 

various positions relative to the image area 422. However, in storing information regarding the image represented by the 

a preferred embodiment, the icon/information area 424 is JPEG data 464*. Media type tags indicate the media type of 

displayed on the right-hand side of each cell 420 as shown. ^ the image, such as whether the image is a single image or a 

The icon/information area 424 is for displaying one or panorama image, for example. The media type tags are used 

more graphical icons, and/or for displaying text information. to select the type of icon is displayed in the icon/information 

The icons and text information displayed in the icon/ area 424 of a cell 420 when the thumb nail 466 of the image 

information area 424 indicate to the user what media types is displayed. 

have been associated with the image displayed in the image 45 In operation, when the digital camera 118 is required to 

area 422. As used conventionally, the phrase "associating a display a set of cells 420 in the view finder 402, the digital 

media type with an object" means identifying the specific camera 118 first retrieves each image's extended file 470 

types of media included in that object, such as graphics, text, from memory. After the appropriate file is retrieved, the 

and sound. thumb nail 466* is displayed in the image area 422 of the cell 

FIG. 7 is a table listing example media types and corre- 50 420. While the thumb nail is being displayed, the tags stored 

sponding icons that may be associated with a captured in the information field 472 are read. Based on the content 

image. The media type of a captured image may represent a of the tags, the appropriate icon is then displayed in the 

single image, a time lapse or burst image, a movie clip, or icon/information area 424 of the cell 420. 

a panorama. The media type may also represent sound, Besides media tags, the information field 472 may also 

where the corresponding icon indicates that a sound clip is 55 include other types of tags for storing additional information 

attached to the image displayed in the image area 422. regarding the image and/or the camera 118 itself. For 

Other media types may also be associated with a captured example, a tag could be used to indicate the settings of the 

image that are not shown in FIG. 7, such as a snide show and camera 118 at the time the image was captured, or indicate 

a folder, for example. A slide show comprises several images the identity of the camera manufacturer, for instance. The 

stored sequentially in the same file, while a folder is one or 60 information in these tags may be accessed through the 

more images stored in the directory or folder. With such buttons on the camera interface 430. The information may 

media types, the image area 422 would display the first then be displayed either as text in the icon/information area 

image in the group or a representative image from the folder, 424, or displayed in a dialog box that is displayed in the view 

and the icon/information area 424 would display an graphi- finder 402. 

cal icon representing a slide show or folder, respectively. 65 Displaying media icons and other information in the 

Displaying icons and text information in the icon/ icon/information area 424 provides the advantage of indi- 

information area 424 according to the present invention eating to the user information regarding the images mat the 
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user otherwise would not have immediate access to. This 
feature provides a digital camera interface that is both easy 
to user and more user friendly than traditional interfaces. 

Referring still to FIG. 9, as stated above the expanded file 
format 470 also includes a sound field 474. The sound field 5 
474 contains digital sound data that has been recorded for 
the image using the sound button 414, or contains a sound 
clip that has otherwise been associated with the image. 
When the user selects one of the cells 420 in the view finder 
402, the full-sized image is displayed in the view finder 402 10 
from the JPEG data 464, while sound is played using the 
sound from the sound field 474. 

The extended file format 470 of the present invention also 
supports multiple image media types. Multiple image media 
types are media types that comprise more than one image. 15 
Examples include a timelapse, a slide show and a movie clip. 
In multiple image media types, the multiple images are 
preferably stored in one file. 

FIG. 10 is a block diagram illustrating a multiple image 
file format 480 that supports these multiple image media 20 
types. As shown, the multiple image file format 480 pref- 
erably includes a series of extended file formats 470 that 
correspond to each image in the multiple image file. The 
multiple image file format 480 also includes a header 482 
pointing to each of the extended file formats 470\ In 25 
operation, the file is retrieved and the header 482 is read in 
order to sequentially access each of the extended file formats 
470. Each of the extended file formats 470 are then used to 
display their respective images in the view finder 402. Other 
formats for the multiple image file format 480 may also be 30 
used. For example, the file format 480 could comprise only 
one header 482, one thumbnail, and multiple JPEG data 
files. 

A method and system for displaying images in the inter- ^ 
face of a digital camera has been disclosed. Although the 
present invention has been described in accordance with the 
embodiments shown, one of ordinary skill in the art will 
readily recognize that there could be variations to the 
embodiments and those variations would be within the spirit ^ 
and scope of the present invention. Accordingly, many 
modifications may be made by one of ordinary skill in the art 
without departing from the spirit and scope of the appended 
claims. 

What is claimed is: 45 

1. A method for displaying a series of images captured by 
a digital camera, the digital camera including a user interface 
that includes a view finder, the method comprising the steps 
of: 

(a) storing each one of the captured images, each one of 5Q 
the captured images having one or more media types 
associated therewith, wherein the media types include 

a still image, a burst image, a time lapse image, a 
panorama image, a movie clip, and sound; 

(b) displaying a plurality of image cells in the view finder, 55 
wherein each of the image cells corresponds to one of 
the captured images; 

(c) providing at least one of the image cells with an image 
area for displaying the corresponding captured image; 

(d) providing the at least one image cell with an icon area 60 
adjacent to the image area for displaying additional 
information regarding the corresponding captured 
image; and 

(e) displaying graphical icons in the icon area indicating 
the media types associated with the captured image. 65 

2. A method as in claim 1 wherein step (a) further includes 
the step of: 
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(al) storing each of the captured images in a file format 
that includes compressed image data, thumb nail image 
data, and information indicating the associated media 
types. 

3. A method as in claim 2 wherein step (c) further includes 
the step of: 

(cl) displaying the captured image in the at least one 
image cell by displaying the thumb nail image date 
from the respective file format. 

4. A method as in claim 3 wherein step (a) further includes 
the step of: 

(a2) storing media type information in the file format 
regarding the media types associated with the respec- 
tive captured images. 

5. A method as in claim 3 wherein step (d) further includes 
the step of: 

(d3) displaying text in the icon area of the at least one 
image cell corresponding to the media type information 
stored in the file format. 

6. A method as in claim 5 wherein step (a) further includes 
the step of: 

(a3) storing media types comprising multiple images in a 
multiple media type file format, the multiple media 
type format including plurality of file formats for each 
of the multiple images, and a header for pointing to 
each of the file formats. 

7. A system for displaying a series of images captured by 
a digital camera, the digital camera including a user interface 
that includes a view finder, the system comprising: 

means for storing each one of the captured images, each 
one of the captured images having one or more media 
types associated therewith, wherein the media types 
include a still image, a burst image, a time lapse image, 
a panorama image, a movie clip, and sound; 

means for displaying a plurality of image cells in the view 
finder, each of the image cells corresponding to one of 
the captured images, wherein at least one of the image 
cells includes an image area for displaying the corre- 
sponding captured image, and an icon area adjacent to 
the image area for displaying additional information 
regarding the corresponding captured image; and 

means for displaying graphical icons in the icon area 
indicating the media types associated with the captured 
image. 

8. A system as in claim 7 wherein each of the captured 
images are stored in a file format that includes compressed 
image data, thumb nail image data, and information indi- 
cating the associated media types. 

9. A system as in claim 8 wherein the captured image is 
displayed in the at least one image cell by displaying the 
thumb nail image data from the respective file format. 

10. A system as in claim 9 wherein media type informa- 
tion for each captured image is stored in a respective file 
format. 

11. A system as in claim 10 wherein text is displayed in 
the icon area of the at least one image cell corresponding to 
the media type information stored in the file format. 

12. A system as in claim 11 wherein media types com- 
prising multiple images are stored in a multiple media type 
file format, the multiple media type format including plu- 
rality of file formats for each of the multiple images, and a 
header for pointing to each of the file formats. 

13. A digital camera device comprising: 

a memory device coupled to the digital camera device for 
storing sets of image data, each set of the image data 
having one or more media types associated therewith, 
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wherein the media types include a still image, a burst 
image, a time lapse image, a panorama image, a movie 
lip, and sound; 
a memory manager for allocating storage locations within 
the memory device to store the sets of image data, the 5 
image data stored in a file format that includes the 
image data, a thumb nail image of the image data, and 
an information field for storing information regarding 
the image data, including the associated media types; 
and 
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an interface coupled to the memory device for displaying 
a plurality of image cells corresponding to the image 
data, wherein at least one of the image cells includes an 
image area for displaying the thumb nail image of the 
corresponding image data, and an icon area adjacent to 
the image area for displaying additional information 
regarding the corresponding image data, including 
graphical icons indicating the media types associated 
with the captured image. 

* * * * * 
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